The Importance of Interaction in Sonification
نویسندگان
چکیده
This paper argues for a special focus on the use of dynamic human interaction to explore datasets while they are being transformed into sound. We describe why this is a special case of both human computer interaction (HCI) techniques and sonification methods. Humans are adapted for interacting with their physical environment and making continuous use of all their senses. When this exploratory interaction is applied to a dataset (by continuously controlling its transformation into sound) new insights are gained into the data’s macro and micro-structure, which are not obvious in a visual rendering. This paper reviews the importance of interaction in sonification, describes how a certain quality of interaction is required, provides examples of the techniques being applied interactively, and outlines a plan of future work to develop interaction techniques to aid sonification.
منابع مشابه
Sonic Interaction Design: New Applications and Challenges for Interactive Sonification
Sonic Interaction Design (SID) is the exploitation of sound as a principal channel to convey information, meaning as well as aesthetic and emotional qualities in interactive contexts [1]. SID is a new young research field that offers novel perspectives for interactive artefacts and multimodal user interfaces that use sound at the core of their designs as means to interact with the user or to co...
متن کاملParticipatory Design Research Methodologies: a Case Study in Dancer Sonification
Given that embodied interaction is widespread in HumanComputer Interaction, interests on the importance of body movements and emotions are gradually increasing. The present paper describes our process of designing and testing a dancer sonification system using a participatory design research methodology. The end goal of the dancer sonification project is to have dancers generate aesthetically p...
متن کاملEndogenous Biologically-Inspired Visualization Immersed within an Art of Complex Systems
We document techniques and insights gained through the creation of interactive visualizations of biologically-inspired complex systems that have been exhibited as mixed-reality art installations since 2007. A binding theme is the importance of endogenous accounts: that all perceivable forms have dynamic ontological capacities within the world; that the simulated world is able to autonomously or...
متن کاملSurface Interactions for Interactive Sonification
This paper presents novel interaction modes for Model-Based Sonification (MBS) via interactive surfaces. We first discuss possible interactions for MBS on a multi-touch surface. This is followed by a description of the Data Sonogram Sonification and the Growing Neural Gas Sonification Model and their implementation for the multi-touch interface. Modifications from the original sonification mode...
متن کاملMulti-touch Interactions for Model-based Sonification
This paper presents novel interaction modes for Model-Based Sonification (MBS) via a multi-touch interface. We first lay out details about the constructed multi-touch surface. This is followed by a description of the Data Sonogram Sonification Model and how it is implemented using the system. Modifications from the original sonification model such as the limited space scans are described and di...
متن کامل